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ABSTRACT 

This overview of the Massachusetts Comprehensive Assessment 
System (MCAS) tests is designed to help schools implement the 
Massachusetts"Curriculum Frameworks." For this fourth administration of the 
MCAS tests in 2001, the design of the tests remains essentially the same, but 
there are some changes highlighted in this overview. The first chapter 
explains the intent and structure of this document. The second chapter 
provides an overview of the MCAS and highlights updates related to 
administration in 2001. Chapters 3 through 6 each contain an overview of MCAS 
test specifications, administration, and features for one content area. 

Sample items are included for the tests being given for the first time in 
2001. The content areas are: (1) English Language Arts; (2) Mathematics; (3) 

Science and Technology/Engineering; and (4) History and Social Science . Seven 
appendixes contain learning standards from the Curriculum Frameworks. (SLD) 
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Commissioner’s Foreword 



Dear Colleagues: 

In preparation for the fourth administration of the Massachusetts Comprehensive 
Assessment System state tests, I am pleased to present The Massachusetts 
Comprehensive Assessment System: Overview of the MCAS 2001 Tests. The 
design of MCAS tests remains essentially the same, but there are some important 
changes to the MCAS testing schedule as we prepare to test across different grade 
levels this year. 

We also intend this overview to help schools implement the Massachusetts 
Curriculum Frameworks. I believe that teachers and administrators will find the 
information on MCAS tests and the sample materials provided in this publication 
to be especially helpful in their effort to bring the learning standards to life in 
classrooms throughout Massachusetts. 



Sincerely, 




David P. Driscoll 
Commissioner of Education 
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I. Purpose and Structure 
of This Document 



Document Purpose 

The purpose of this document is to provide local educators with an overview of the 
Massachusetts Comprehensive Assessment System (MCAS) 2001 tests, highlighting the 
new tests that will be administered for the first time in 2001. 

This document provides 

I information on recent refinements to selected Massachusetts Curriculum 
Frameworks and the effects of those changes on the MCAS 2001 tests 

I details about test design for the MCAS 2001 tests 

I sample test questions (items) for the MCAS tests being administered for the 
first time in 2001 

Please note that some information in this document updates and supersedes information 
given in the previously published MCAS Guides. The Guides provide additional details 
on the content and structure of the MCAS tests in their respective content areas; 

I Guide to the Massachusetts Comprehensive Assessment System: 

English Language Arts (February 1998) 

I Guide to the A lassachusetts Comprehensive Assessment System: 

Mathematics (January 1998) 

I Guide to the Massachusetts Comprehensive Assessment System: 

Science & Technology Onnnnry 1998) 

I Guide to the Massachusetts Comprehensive Assessment System: 

History and Social Science, Spring 1999 
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Document Structure 

This first chapter explains the overall intent and structure of this document. 

Chapter II provides an overview of the Massachusetts Comprehensive Assessment System 
and highlights updates related to the MCAS 2001 test administration. 

Chapters III through VI each contain an overview of MCAS test specifications, adminis- 
tration, and features for one content area. Sample items are included for the tests being 
administered for the first time in 2001. 

Important Note Regarding Sample Materials 

The sample materials included in this document illustrate how Framework learning stan- 
dards will be assessed by MCAS tests. Please note that these sample materials address 
only a select number of learning standards and do not represent the entire range of items 
that appear on actual MCAS tests. 

Also note that these sample items are not formatted as they appear in actual MCAS test 
booklets, nor do they include all student directions or the amount of response space pro- 
vided to students during test administration. 
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n. Overview of the Massachusetts 
Comprehensive Assessment System (MCAS) 

A. MCAS Overview 

The Massachusetts Comprehensive Assessment System (MCAS) is the Commonwealth’s 
statewide assessment program developed in response to the Education Reform Law of 
1993. The primary purposes of MCAS nre 

I to measure the perform n nee of inclivicliinl students, schools, and districts based 
on the state standards outlined in the Massachusetts Curriculum Frameworks 

I to raise student achievement 

I to improve classroom instruction 

I to determine competency in English language arts and mathematics in order 
to award high school diplomas 

The 1993 Education Reform Law mandates that a// students in the tested grades who are 
educated with Massachusetts public funds participate in MCAS, including 

I students enrolled in public schools 

I students enrolled in charter schools 

■ students enrolled in educational collaboratives 

I students enrolled in private schools receiving special education that is publicly 
funded by tlie Commonwealth, including Chapter 766-approved private schools 
within and outside Massachusetts 

I students receiving educational services in institutional settings 

I students in the custody of either the Department of Social Services or the 
Department of Youth Services 

I students with disabilities 

I students with limiicd English proficiency^ 



^ LEP students who have been enrolled in United States schools for three or fewer years AND are 
ineligible to take the Sprinihh-language version of MCAS arc not required to participate in MCAS 
testing. For further informal ion, see (he publication, Requirements for the Participation of Students 
with Limited English Prolkicucy, (Spring 2000 Upebiv). 
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Massachusetts Curriculum Frameworks 

Massachusetts students are tested by MCAS in the following content areas: 

I English Language Arts (ELA) 

I Mathematics 

I Science and Technology/Engineering 
I History and Social Science 

MCAS tests are based exclusively on the learning standards (and, in History and Social 
Science, on core knowledge topics) contained in the Massachusetts Curriculum 
Framework for the content area tested.^ 

MCAS test questions (items) focus on general Framework learning standards and/or their 
corresponding grade-specific standards. Some items incorporate standards identHied for 
preceding grade levels; consequently, students are often required to demonstrate cumula- 
tive content knowledge and skills (e.g., grade 10 students may be tested on learning 
standards identified in a Framework from pre-Kindergarten through grade 1 0) . 

Item Types 

Four types of test items are used on MCAS tests: 

I Multiple-choice questions are included on all MCAS tests except ELA 
Composition, and require students to select the correct answer from a list 
of four options. 

Multiple-choice items are machine-scored by optical scanners. Correct answers 
are assigned a score of 1 point and incorrect answers are assigned a score of 
0 points. 

I Open-response questions are included on all MCAS tests except ELA Composition, 
and require students to generate, rather than recognize, a response. Depending 
on the content area tested, students provide a written response of one or two 
paragraphs, or create a chart, table, diagram, or graph. 

Open-response items receive a score from 0-4, based on item-specific rubrics used 
by trained professional scorers. 

I Short-answer questions are included only on MCAS Mathematics tests, and 
require students to generate a brief response, usually a numeric solution to a 
computation or a short statement. 

Short-answer items are scored by trained scorers. Based on an item-specific 
rubric, correct answers are assigned a score of 1 point and incorrect answers 
are assigned a score of 0 points. 

^ Please note that certain learning standards, including all learning standards in the English Language 
Arts Curriculum Frameworks Media strand, cannot be assessed using a large-scale papcr-and-pcncil 
format, and are not assessed by MCAS. 
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I Writing prompts are included only on MCAS ELA Composition tests, and 
require students to respond by creating a written composition. 

ELA Compositions are scored in two areas by trained scorers: 

•Topic Development (2-12 points) 

• Standard English Conventions (2-8 points) 

Common Items/Matrix-Sampled Items 

Most MCAS Student Test Booklets are issued in several different forms at each grade 
level.^ Approximately 80% of the test items in any test booklet are identical (common 
items) on all test forms. The remaining 20% of the test items in each test booklet 
va/y (matrix-sampled items) from form to form. 

Individual student test scores arc based exclusively on common items. 

Matrix-sampled items are used to equate test forms across MCAS administrations and to 
field-test items for possibl<^fiiuire use as common items. In School and District Reports, 
the Subject Area Subscorc pages include data generated from responses to both common 
and matrix-sampled items: this is the only instance in which matrix-sampled items are 
used to generate MCAS results. Ah othei' school and district results are generated from 
student responses to common items only."^ 

Unlimed Test Sessions 

MCAS tests are designed to be untimed. While the recommended time allotment per 
session should be adequate for most students, additional time is provided, as necessary, 
for any student inhiblc lo con}jj!c(c a (cst session within the allotted time. The amount of 
additional time per session generally considered to be reasonable may range from five 
minutes to 30 minutes. 



^ The MCAS ELA Comi)osiiinn Stu(l(!iii Tvs\ Booklet niicl the ELA Composition Make-Up Student Test 
Booklet are each issued in one Ibrni only, using cliri'erent writing prompts; both prompts are considered 
common items. 

In addition to the standard forms of all otlier content area test booklets, three non-standard versions 
of each booklet (large*j)i int. Ih aille, and Spanislvlanguage) are available for use by eligible students. 
For further information on which siudeiits are eligible to use these non-standard Student Test Booklets, 
please refer to tlie MCAS documents, Requirements for the Participation of Students with Disabilities 
(Spring 2000 UjHbte) and Requirements for the Participation of Students with Limited English 
Proficiency (Spring 2000 Update). Both puldications are available on the Department’s website at 
www.doe.mass.edu/mcas. Uj)dates to those documents as they relate to the MCAS 2001 administration 
are expected in the winter semester of the 2000-2001 school year. 

^ For further information on the |)iirpose and use of matrix-sampled items, please refer to the MCAS 
documents, Release of Spring 2000 'lest Kerns and Guide to Interpreting the Spring 2000 MCAS 
Reports for Schools and Oisiricis. 
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Grades and Content Areas Tested in Spring 2001 



Table 1. MCAS 2001 Tests 


Grade Tested 


Content Area Tested 




English Language Arts 


Mathematics 


Science and 
Technology/Engineering 


History and 
Social Science 


Composition 

(Writing) 


Language and 
Literature 
(Reading) 


3 




X 








4 


X 


X 


X 






5 








X 


X 


6 






X 






7 


X 


X 








8 


X* 


X* 


X 


X 


X 


9 








(see note) 




10 


X 


X 


X 


(see note) 


X 



^ This will be the final administration of the grade 8 English Language Arts test (both components). 



NOTE: The one grade 10 MCAS Science & Technology test administered in previous years will be 
replaced in the future by six content-specific tests to be taken by students in grades 9 and 10. Separate 
tests will be given in the five areas of biology, chemistry, physics (introductory), earth science, and 
technology/engineering, and an integrated science test will be given that includes biology, chemistry, 
physics, and earth science. Question Tryouts in these content areas will take place in the spring of 
2001. Please see chapter V, section G of this document for further information. 
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Reporting of MCAS Test Results 

MCAS test results are reported through scaled scores and performance levels for 
individual students, schools, and districts. 





Table 2. MCAS Performance Levels | 


MCAS Performance Level 


General Description 


Scaled Score Range 


Advanced 


Students at this level demonstrate 

• a comprehensive and in-depth understanding 
of rigorous subject matter 

• the ability to provide sophisticated solutions 
to complex problems 


260-280 


Proficient 


Students at this level demonstrate 

• a solid understanding of challenging subject matter 

• the ability to solve a wide variety of problems 


240-259 


Needs Improvement 


Students at this level demonstrate 

• partial understanding of subject matter 

• the ability to solve some simple problems 


220-239 


Failing 


Students at this level demonstrate 

• minimal understanding of subject matter 

• an inability to solve simple problems 


200-219 



For additional information about sealed scores and performance levels, please refer to the 
MCAS publication, Guide to Interpreting the Spring 2000 MCAS Reports for Schools 
and Districts, available on the Department’s website at www.doe.mass.edu/mcas. 

The following reports of MCAS test results arc among those issued in the fall following 
each year’s MCAS administration: 

I Parent/Giicirdicin Reports (oacli report contains confidential student data) 

I School Report 

I Test Item Anniysis Report (this report contains confidential student data) 

I District Report 

I Summary of District Performance 
I State Report of Results 
I Technical Report 

Parent/Guardian Reports and Test Item Analysis Reports contain confidential student 
data that are not released to the public. 

Please see the Department’s website at www.doe.mass.edu/mcas for further information 
about all of these annual reports. 
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Table 3 below shows how results for each 2001 MCAS tost will be i epoi ted. 



Table 3. MCAS Results Reported in 2001 


MCAS Test 


Results Reported in 2001 


Grade 3 

Reading 


Fully reported: student, school, and district scaled scores and performance levels 
NQTE: Results will be based ONLY on multiple-choice items. 


Grade 4 

ELA 


Fully reported: student, school, and district scaled scores and performance levels 


Mathematics 


Fully reported: student, school, and district scaled scores and performance levels 


Grade 5 

Science and 
Technology/Engineering 


Qnly Test Item Analysis Reports provided to schools: no scaled scores or 

performance levels 


History and Social Science 


Qnly Test Item Analysis Reports provided to schools; no scaled scores or 

performance levels 


Grade 6 

Mathematics 


Fully reported: student, school, and district scaled scores and performance levels 


Grade 7 

ELA 


Fully reported: student, school, and district scaled scores and performance levels 


Grade 8 ELA 


Fully reported: student, school, and district scaled scores and performance levels 


Mathematics 


Fully reported: student, school, and district scaled scores and performance levels 


Science and 
Technology/Engineering 


Qnly Test Item Analysis Reports provided to schools; no scaled scores or 
performance levels 


History and Social Science 


Fully reported: student, school, and district scaled scores and performance levels 


Grade 9 

Science and 
Technology/Engineering 
Question Tryouts 


No results generated or reported 


Grade 10 

ELA 


Fully reported: student, school, and district scaled scores and performance levels 


Mathematics 


Fully reported: student, school, and district scaled scores and performance levels 


Science and 
Technology/Engineering 
Question Tryouts 


No results generated or reported 


History and Social Science 


Qnly Test Item Analysis Reports provided to schools; no scaled scores or 
performance levels 
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C. What’s New for MCAS 2001? 



High School Competency Determination 

MCAS 2001 test results will be the first MCAS results used to determine student eligibility 
for a high school diploma. Students who are members of the graduating class of 2003 are 
required to pass both the grade 10 MCAS English Language Arts and the grade 10 MCAS 
Mathematics tests as one condition for receiving a high school diploma (students must 
also meet all local graduafibn requirements). A scaled score of 220 (the lowest score in 
the Needs Improvement performance level) or higher will be considered a passing score on 
each test. Students who fail cither or both tests will be given multiple opportunities before 
the end of their senior year to retake the test(s) they did not pass. See the Department’s 
website (www.doe.mass.edLi/nicas) or call 1-800-737-5103 for more information. 

New Policy on Approved Bilingual Dictionary Use for Students with 
Limited English Proficiency 

The Department of Education, in its continuing effort to provide maximum access to 

the MCAS tests for all suidcius, has approved a new test accommodation for limited 

English proficient (LEP) smdents. Beginning wiih the MCAS 2001 administration, any 

student who is or has been an LEP suidcnt may use an approved bilingual (word-to- 

word) dictionary or electronic translator during MCAS testing. Approved bilingual 

dictionaries and elccironit: iiansiaiors are limited to those that provide word-to-word 

translations, without definitions. 

o 

A list of approved bilingual dictionaries, including dictionary references for 55 languages 
spoken in Massachusetis schools, appears in the June 2000 Department publication, 
Approved BilingunI Diciionnrics for Use on the MCAS by Students with Limited English 
Proficiency This publication is posted on the Department of Education website at 
www.doe.mass.edu/mcas. 



u 



The Massachusetts Comi’reuensive Assessment System: 
Overview of the MCAS 2001 Tcsis 



17 



BEST COPY AVfi 



0 



m.MCAS2001 
English Language Arts Tests 



The MCAS 2001 Englisli Language Arts (EL A) tests are based on the 1997 English 
Language Arts Curriculum Framework.^ 



A. MCAS English Language Arts Guide Update 

o 

The following information updates and supersedes that given in the MCAS publication, 
Guide to the Massachusetts Comprehensive Assessment System: Engiish Language Arts 
(1998). 

ELA Composition Test 

I The MCAS English Language Arts Composition test (grades 4, 7, 8, and 10) no 
longer includes a “Short Session" (sliort composition), 

I The scoring area for ELA Compositions labeled “Focus and Development” in the 
Guide is now rcfciTed to as “Topic Development,” 

I A separate ELA Composition Make-Up Test is issued and administered at each 
grade level (grades 4, 7, 8, and 10), Each grade’s Make-Up Test uses a different 
writing prompt than the one appearing on the regularly scheduled ELA 
Composition test for tliat grade. Both writing prompts are considered 
common items. 



O 



^ A draft of a second edition of the English Lnnguagc Arts Curriculum Framework, which incorporates 
minor refinements to and clarirications of the learning standards, was submitted to the Massachusetts 
Board of Education for n.virvv in June 2000. The public comment period on this document ended 
October 2, 2000; tlic Board accepted this draft in November 2000. Beginning with the 2002 MCAS 
administration, MCAS ELA tests will he based on the learning standards as presented in this 2000 
Framework. 



o 

ERIC 
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Reporting Categories 

Individual students receive one MCAS English Language Arts score/performance level. 

For grade 3, this ELA score/performance level is generated from the results of the Gradc^ 
Reading Test. In 2001, results for this test will be based on multiple-choice items only. 

For grades 4, 7, 8, and 10, a student's results from both the ELA Composition and the 
ELA Language and Literature tests are combined to generate one overall English 
Language Arts score for that student. These students also receive comments from scorers 
about their ELA Compositions. 

School and district MCAS English Language Arts results are reported under the following 
MCAS reporting categories: 

I Language 

I Literature 

I Composition (not applicable to the Grade 3 Reading Test) 

• Topic Development 

• Use of Standard English Conventions 



n 
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B. Whats New for ELA 2001 ? 



MCAS Grade 3 Reading Test 

In response to the Commonwealth’s increasing emphasis on early literacy, an MCAS 
Grade 3 Reading Test will be administered for the first time in April 2001. The 2001 test 
is similar in structure to the grade 4 MCAS ELA Language and Literature test; it is based 
exclusively on learning standards 4 through 17 of the 1997 Massachusetts English 
Language Arts Curriciihn9 Framework's Language and Literature strands. 

MCAS Grade 7 English Language Arts Test 

In order to provide middle schools with time to target English language arts instruction 
for students before they advance to high school, the MCAS grade 8 ELA test is being 
moved to grade 7. The MCAS 2001 administration will include MCAS English Language 
Arts tests for both grades 7 and 8; 2001 will mark the final administration of the grade 8 
MCAS ELA test. 

No Matrix-Sampled Hems on the Grade 8 English Language Arts Test 
Only common items will appear on the 2001 grade 8 MCAS English Language Arts test. 
No matrix-sampled items are included because the grade 8 English Language Arts test 
will be administered for ilie final time in 2001. Therefore, the 2001 test includes fewer 
items than have been included on previously administered grade 8 MCAS ELA tests. 

Since MCAS student scores have always been based on common items only, comparisons 
of 2001 grade 8 ELA suident scores with past years’ results are still valid. School and dis- 
trict Subject Area Subscore results for grade 8 ELA, however, will not be parallel to past 
years’ reported results. 

High School Competency Determination 

MCAS 2001 test results will be the first MCAS results used to determine student eligibili- 
ty for a high school diploma. Siudents who arc members of the graduating class of 2003 
are required to pass the grade 10 MCAS English Language Arts test (both components) 
in order to receive a high scliool diploma.*^ A scaled score of 220 (the lowest score in 
the Needs Improveman pei fonnancc level) or higher in English Language Arts will be 
considered a passing score. Siudents who fail will be given multiple opportunities before 
the end of their senior yeai to retake the test. See the Department’s website 
(www.doe.mass.edu/mcas) or call 1-800-737-5103 for more information. 






® Grade 10 studcnis who emd nuiinhcrs of t!io gradiiniiiig cinss of 2003 are also required to pass the 
grade 10 MCAS MaOHMuniirs ulsi and meet all local graduation requirements in order to receive a 
high school diploma. 
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